04 Clustering

default
default

Unit 1: Vectors, Book ILA Ch. 1-5

Unit 2: Matrices, Book ILA Ch. 6-11 + Book IMC Ch. 2

Unit 3: Least Squares, Book ILA Ch. 12-14 + Book IMC Ch. 8

Unit 4: Eigen-decomposition, Book IMC Ch. 10, 12, 19

Outline: 04 Clustering

Outline: 04 Clustering

Clustering in Machine Learning

default

Clustering: Goal (Intuition)

default

$\color{#047C91}{\text{Exercise}}$: What is $k$ in the figure above? What is $n$? What is $N$?

Clustering in ECE

Clustering: Goal (Math)

Outline: 04 Clustering

K-means algorithm

(i) Update the groups

(ii) Update the representatives

Pseudo-code

default

Convergence of K-means

Outline: 04 Clustering

default
default
default
default
default
default
default

Outline: 04 Clustering

MNIST Dataset: Find Digits

default

MNIST Results

default
Convergences: best run (blue), worst run (red), average (brown).
default
Representatives.

Wikipedia Dataset: Find Topics

default

Wikipedia Results

default
Convergences: best run (blue), worst run (red), average (brown).

Explore first 3 clusters.

default
default

Questions?

Resources: Book ILA, Ch. 4